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Before we begin, you may want to know this: 



This text is a (slightly edited) excerpt from the book 
'Decision making, politics and quality of life' by Edgar Hartel. 

Most examples, and all persons or organizations 
appearing in them, are invented. 
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1. Introduction - A short one 

2. Problems. All sorts, all sizes. 

Where do they come from? 

3. What is a 'good' or 'bad' decision? 
A definitions intermezzo 

4. What happens when bad decisions 
are made frequently? 

About circles and spirals 

5. How can bad decisions be avoided? 

A short answer 

6. Which factors hinder good decision 
making? An overview 

7. How to overcome the factors that 
hinder good decision making 

Approaches and methods 

8. Decision making theory vs. real life 

Why available tools are not used 

9. An appeal: how you can contribute 

Better decisions, less problems 

10. Conclusion A short one 



A. Quality of life as a decision criterion 

The most important one? 

B. Is there a 'mother of all problems' ? 

How to solve interconnected 
problems 

C. Do not create larger problems while 
solving the original one 

Where is the grass greener? 

D. Factors that hinder good decision 
making - Briefly explained 

E. Quality standards for 
decision making 

What they could look like 




F. How to visualize and evaluate 
decision options Step by step 



G. How to make and use 
argument maps 

Avoid endless discussions 

H. Miscellaneous 

Acknowledgements, remarks, 
contact information 



How to visualize and evaluate decision options 

Step by step 



Estimated reading time: 25-30 minutes 



The 'how to' section 
starts on p. 361 

[p. 9 of this excerpt]. 

Before that, there are 2 pages 
about the 'why'. 



The summary section (p. 427 [75]) 
includes a 1 minute description 
of a 'multi-party decision matrix'. 

Such a diagram is part of a 
decision making process. 

For information about complete 
(full-scale) processes, 
rather see appendix E of the 
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Progress 



Intro done 

Why bother? up next 

Basic diagram 

Diagram upgrades : ... 
... uncertainty handling 
... multi-party capability 

... scoring 

... weighted criteria 

... two-step ratings 

Possible mistakes 
Summary 



Let's assume you are facing a 
complex decision making situation. 

Making a decision support 
diagram is work. Additional work, 
it may seem. 

So why bother? 



Because it helps you to 
avoid the problems 
a bad decision would cause. 

This is the primary reason. 

There are 4 secondary reasons 
on the next page. 



1 . Overview 



Decisions made without overview 

over the situation produce 
random results. Without overview, 

you're partially blind. 
A good diagram gives overview. 

2. Communication 



You may want, or need, to 
communicate your considerations 
to others. A good diagram can do 
this very efficiently. 



3. Cooperation 

You may want, or need, to 
cooperate with others. A diagram 
that shows what each party 
thinks makes this easier. 

4. Documentation 



You may want, or need, to 
document your considerations. 
A good diagram can replace 
many, many pages of text. 
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Progress 



Intro 

Why bother? 

Basic diagram 

Diagram upgrades : ... 
... uncertainty handling 
... multi-party capability 

... scoring 
... weighted criteria 
... two-step ratings 

Possible mistakes 

Summary 



done 
done 
up next 
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Basic diagram 
(decision matrix) 



Option 1 



Criterion 1 



Criterion 2 



Fig. F.1a : basic diagram (decision matrix) 



Option 2 



We start out with a 
basic 'decision matrix' 

This is a table where 
you first arrange your 

decision options and 

your criteria as 
column/row headings. 

(Only 2 of each are 
shown in this example. 
Normally there are 
many more.) 
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Basic diagram 
(decision matrix) 



Option 1 



Criterion 1 



Criterion 2 




Fig. F.1b : basic diagram (decision matrix) 



Option 2 




The cells in this table 
(or matrix) can then be 
filled with your ratings. 

A rating expresses 
your judgement 
(or evaluation) 
of an option/criterion 
combination. 
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Basic diagram 
(decision matrix) 



Purchase price 



Build quality 



Buy 
'discount price' 
product A 



affordable 



somewhat flimsy 



Fig. F.1c : basic diagram (decision matrix) 



Buy 

'premium edition' 
product B 



quite expensive 




That might look like the 
example on the left. 
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Basic diagram 
(decision matrix) 



Purchase price 



Build quality 



Buy 
'discount price' 
product A 



affordable 



somewhat flimsy 



Fig. F.1d : basic diagram (decision matrix) 



Buy 

'premium edition' 
product B 



quite expensive 




But when dealing with 
many ratings, you need 
to use a rating scale 
instead of individual 
phrases (such as 
'affordable'). 

Otherwise you will lose 
overview. 
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Rating scale 



Rating : 
Symbol (score) : 



very 
negative 





moderately 




moderately 




negative 


negative 


neutral 


positive 


positive 


| " (-2) 


(-1) 


o (0) 


+ (+1) 


++ ( +2 ) 



very 
positive 



ive 
(+3) 



This scale is very useful. 

3 degrees of 'positive' or 
'negative' give enough precision 
in most situations, but are 
still easy to handle. 



But it's not complete yet. 



Fig. F.2a : rating scale 
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Rating scale 



Rating : 


not 


very 




moderately 




moderately 






acceptable 


negative 


negative 


negative 


neutral 


positive 


positive 


Symbol (score) : 


! (n/a) 




(-2) 


(-1) 


o (0) 


+ (+1) 


++ ( +2 ) 



very 
positive 



3, 



We also need a 
'not acceptable' rating. 

Unlike the other ratings, this one 
cannot be compensated for. 



It just rules out any decision 
option that earns such a rating 

on at least one criterion, 
no matter how well the option 

scores on other criteria. 



Therefore use it only when 
'very negative' is not sufficient. 



Fig. F.2b : rating scale 
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Basic diagram 
(decision matrix) 



Buy 
'discount price' 
product A 



Buy 

'premium edition' 
product B 



Purchase price 



Build quality 




moderately negative 

(-1) 




Fig. F.1e : basic diagram (decision matrix) 




Applying the scale to 
the example from p. 364 
[12] gives us this result. 



However, the benefits of 
using this rating scale 
become more obvious 

when dealing with more 
options and criteria. 
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Basic diagram 
(decision matrix) 






Criterion 19 






Criterion 20 





Fig. F.3a : basic diagram (decision matrix) 



Option 4 Option 5 

Description text Description text 



±3 



+ 















~ 









+ 









+ 

















- 








+ 






















+ 



For instance, you could 
compare 5 options on 
20 criteria, and yet easily 
maintain overview over 
all their advantages and 
disadvantages. 

This is something 
you simply could not do 
without a diagram 
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Basic diagram 
(decision matrix) 






Criterion 19 






Criterion 20 





Fig. F.3b : basic diagram (decision matrix) 



Option 4 Option 5 

Description text Description text 



±3 



+ 















~ 









+ 









+ 

















- 








+ 






















+ 



This matrix fits on a 
single A4/Letter-sized 
page, using a 10 pt font 
(a typical newspaper font 
is 8-9 pt). 

Note that it was not 
necessary to evaluate 
option 4 any further 
after it was judged 
'not acceptable' on 
one criterion. 
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Basic diagram 
(decision matrix) 



Categories 




Category 1 Criterion 1 



Category 3 



Category 4 

Criterion 14 
Category 5 Criterion 15 



Criterion 16 
Category 6 Criterion 17 



Criterion 18 
Category 7 Criterion 19 
Criterion 20 



Option 1 
Description text 




Option 2 
Description text 










+ 





+ 

~0~ 



Fig. F.3c : basic diagram (decision matrix) 



Option 4 Option 5 

Description text Description text 



±3 



+ 















— 









+ 









+ 

















- 








+ 






















+ 



When dealing with 
many criteria (or options), 

it is usually helpful to 
group them by category. 

Examples of criteria 

categories: 
finance, workload, 
quality of life, ethics, 
environment, compliance, 
effectiveness, feasibility, 
short-term, long-term. 
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The diagrams shown are 

easy to make, and 
easy to explain to others. 

They are the right choice if 
simplicity is paramount 
(and only then). 



On the next pages, 
we develop the decision matrix 
concept further. 

These diagrams can do things 
the basic ones can't. 



Progress 



Intro done 

Why bother? done 

Basic diagram done 

Diagram upgrades : ... 
... uncertainty handling up next 
... multi-party capability 

... scoring 

... weighted criteria 

... two-step ratings 

Possible mistakes 
Summary 




When you work with your ratings, 
you will sometimes feel uncertain 
about how to rate an 
option/criterion combination. 



This might happen because you 
do not have enough information to 
give a precise rating, or because 
you want your rating 'somewhere 
between' two rating levels. 




With a little upgrade, 
a decision matrix diagram can 
handle such uncertainties. 



This does not only 
make the rating work easier, 
it also adds very valuable 
information to the diagram. 



Basic diagram 
(decision matrix) 



Buy 
'discount price' 
product A 



Purchase price 



Build quality 




moderately negative 

(-1) 



Fig. F.1f : basic diagram (decision matrix) 



Buy 

'premium edition' 
product B 




We have seen this 
example before. 

But now let's 
change the layout of the 
rating cells ... 



Uncertainty handling 



Buy 
'discount price' 
product A 



Purchase price 



Build quality 



Fig. F.4a : uncertainty handling 



to this format. 



Buy 

'premium edition' 
product B 




There is made room 
for a whole rating scale 
in each cell. 

The chosen ratings are 
marked on the scale. 

But it is now possible 
to mark more than one 
rating level. 
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Uncertainty handling 



Purchase price 



Build quality 



Buy 
'discount price' 
product A 



Hi 



















Fig. F.4b : uncertainty handling 



Buy 

'premium edition' 
product B 









■ 



In this example, 
you are certain in your 
judgement of the 
purchase price, but 
uncertain about the 
build quality. 

Product A's build quality 
appears more uncertain 
(and worse) than 
product B's. 
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Uncertainty handling 



Option 1 
Description text 



I 



mm 



Ml 



Option 2 
Description text 




rrrrrn 






hi 


hi 




1 


HI 


■ 


II 






II 










1 




1 




■ III 


INN 


1 






1 


■ 


1 







ODtion 3 
Description text 


Option 4 
Description text 








1 


■ 


1 III 




1 




N-l-H 




m 


II 1 




















in 








■ 








Hill 








HH 








Hill 
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■ 








II 


















II 
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■ llll 
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Mion 5 

;scription text 






III 










1 


















* 




1 














1 


I 


• 





EH 



n 



HE 



Fig. F.4c : uncertainty handling 



A full A4/Letter page 
example could look 
like this. 

(It's an upgraded 
version of the 
p. 369 [17] diagram.) 



A natural consequence 

of uncertainty are 
'worst case' / 'best case' 
scenarios. 



More about this later 
in the 'scoring' section. 



Progress 



Intro 

Why bother? 

Basic diagram 

Diagram upgrades : ... 
... uncertainty handling 
... multi-party capability 

... scoring 
... weighted criteria 
... two-step ratings 

Possible mistakes 

Summary 



done 
done 
done 

done 
up next 
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The previous diagrams 
were designed for a single 
decision maker. 

But often there are more decision 
makers (and/or advisors) involved. 

They will agree on some matters, 
and disagree on others. 



Making all views clearly visible 
is in the interest of transparency 
and good decision making. 

The upcoming 
'multi-party decision matrix' 
is designed to do that. 



Uncertainty handling 



Purchase price 



Build quality 



Buy 
'discount price' 
product A 



Hi 



















Fig. F.4d : uncertainty handling 



Buy 

'premium edition' 
product B 




Back to our example. 

Let's say the shown 
ratings are Alice's. 

But now she wants to 
see other opinions ... 
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Multi-party capability 



Buy 
'discount price' 
product A 



Purchase price 



Director Alice 



Build quality 




Fig. F.5a : multi-party capability 



Buy 

'premium edition' 
product B 



□ 



Director Alice 



Director Alice 



... so we change the 
layout of the rating cells 
once more. 

Alice's ratings are still 
there, but now there is 
room for more. 
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Multi-party capability 



Buy 
'discount price' 
product A 



Buy 

'premium edition' 
product B 



Purchase price 



Director Alice 
Director Bob 
Accountant Carol 
Engineer Dave 



□ 


Director Alice 


□ 


Director Bob 


■ 


Accountant Carol 




Engineer Dave 



Build quality 



■ 1 


Director Alice 


□ 


Director Bob 


■ ■ 


Accountant Carol 


■ 


Engineer Dave 



Director Alice 
Director Bob 



Accountant Carol 
Engineer Dave 



Fig. F.5b : multi-party capability 



3 other parties were 
asked for their views, 
and the diagram shows 
these. 

Hence the (maybe 
awkward but descriptive) 
term multi-party 
decision matrix for this 
kind of diagram. 



Multi-party capability 



Purchase price 



Build quality 



Buy 
'discount price' 
product A 



Director Alice 
Director Bob 
Accountant Carol 
Engineer Dave 



■ 1 


Director Alice 


□ 


Director Bob 


■ ■ 


Accountant Carol 


■ 


Engineer Dave 



Buy 

'premium edition' 
product B 



□ 


Director Alice 


□ 


Director Bob 


■ 


Accountant Carol 




Engineer Dave 



Director Alice 
Director Bob 



Accountant Carol 
Engineer Dave 



Note the black lines 

separating the 
decision makers from 
the advisors. 

Please take a moment 
to examine the ratings. 



Fig. F.5c : multi-party capability 
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Multi-party capability 



Purchase price 



Build quality 



Buy 
'discount price' 
product A 



■ Director Alice 

■ Director Bob 

■ Accountant Carol 
Engineer Dave 

Director Alice 
□ Director Bob 

Accountant Carol 
■□ Engineer Dave 



Fig. F.5d : multi-party capability 



Buy 

'premium edition' 
product B 



□ 



□ 




Director Alice 
Director Bob 
Accountant Carol 
Engineer Dave 

Director Alice 
Director Bob 



Accountant Carol 
Engineer Dave 



You will notice 
(for instance) that: 

- there are no major 

disagreements, 
except the marked one 

- nobody uses a 'not 
acceptable' rating 



Multi-party capability 



Purchase price 



Build quality 



Buy 
'discount price' 
product A 



Director Alice 
Director Bob 
Accountant Carol 
Engineer Dave 



■ 1 


Director Alice 


□ 


Director Bob 


■ ■ 


Accountant Carol 


■ 


Engineer Dave 



Buy 

'premium edition' 
product B 



□ 


Director Alice 


□ 


Director Bob 


■ 


Accountant Carol 




Engineer Dave 



Director Alice 
Director Bob 



Accountant Carol 
Engineer Dave 



- Bob is certain about 
everything 

(does he have more 
information? Or more 
self-confidence?) 



Fig. F.5e : multi-party capability 
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Multi-party capability 



Purchase price 



Build quality 



Buy 
'discount price' 
product A 



■ Director Alice 

■ Director Bob 

■ Accountant Carol 
Engineer Dave 

Director Alice 
□ Director Bob 

Accountant Carol 
■□ Engineer Dave 



Fig. F.5f : multi-party capability 



Buy 

'premium edition' 
product B 



□ 



□ 



■ 



Director Alice 
Director Bob 
Accountant Carol 
Engineer Dave 

Director Alice 
Director Bob 



Accountant Carol 
Engineer Dave 



- Carol has no strong 
opinion about build 
quality 

(that is good judgement 
if she's no expert) 
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Multi-party capability 



Buy 
'discount price' 
product A 



Buy 

'premium edition' 
product B 



Purchase price 



Director Alice 
Director Bob 
Accountant Carol 
Engineer Dave 



□ 


Director Alice 


□ 


Director Bob 


■ 


Accountant Carol 




Engineer Dave 



Build quality 



■ 1 


Director Alice 




Director Alice 


□ 


Director Bob 


■ 


Director Bob 


■ ■ 


Accountant Carol 




Accountant Carol 


■ 


Engineer Dave 




Engineer Dave 



Fig. F.5g : multi-party capability 




- Dave really doesn't like 
product A's build quality 

(which should get the 
decision makers' 
attention, because he is 
their expert for that) 
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/ Some notes 

regarding practical aspects: 

- of course you can put more than 
4 parties' ratings in each cell 
(up to 10: no problem, 
more than 15: think twice) 

- making such diagrams takes 
time. But far less time than 
having several parties writing 
their own reports. You can skip 
y the report writing if you use a 
\ diagram (no need for both) 



- let each party do their ratings 
independently. They should not 
see each other's ratings until 
these are complete 

- if you don't want to make 
diagrams yourself, you could 
delegate this task to someone 
(trustworthy, willing and 
competent) else 



Progress 



Intro 

Why bother? 

Basic diagram 

Diagram upgrades : ... 
... uncertainty handling 
... multi-party capability 

... scoring 
... weighted criteria 
... two-step ratings 

Possible mistakes 

Summary 



done 
done 
done 

done 
done 
up next 
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'Calculating a numerical score 
for each decision option 
often helps to find the best option.' 

Is that true? 

Not quite. Looking at a 
single score (per option) can be 
very misleading. Because single 

scores imply that all options 
come without (or with the same) 
uncertainty or risk attached. And 
that is usually wrong. 



Therefore, at least 2 scores 
(per option) are required: 
one for the 'worst case', 
one for the 'best case' ratings. 

A 3rd score for 'average' is 
nice to have. 

These 3 scores combined often 
do help to find the best option. 



Scoring 



Purchase price 



Build quality 



Buy 
'discount price' 
product A 



® 



Director Alice 
Director Bob 
Accountant Carol 
Engineer Dave 





Director Alice 




Director Bob 


■ 1 ■ 


Accountant Carol 


■ 


Engineer Dave 




Fig. F.6a : scoring 



Buy 

'premium edition' 
product B 



□ 



□ 



■ 



Director Alice 
Director Bob 
Accountant Carol 
Engineer Dave 



Director Alice 
M Director Bob 
!EM Accountant Carol 
Engineer Dave 




According to Alice, 
the worst case score for 
this option is 0.0 



Purchase price: +2 (■) 
Build quality: -2 (■) 







divided by 2 criteria = 0.0 
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Scoring 



Purchase price 



Build quality 



Buy 
'discount price' 
product A 





Director Alice 
Director Bob 


rrm 


Accountant Carol 
Engineer Dave 




Director Alice 
Director Bob 


■ ■ 
■ 


Accountant Carol 
Engineer Dave 




Fig. F.6b : scoring 



Buy 

'premium edition' 
product B 



□ 



□ 



■ 



Director Alice 
Director Bob 
Accountant Carol 
Engineer Dave 



Director Alice 
M Director Bob 
!EM Accountant Carol 
Engineer Dave 




According to Alice, 
the best case score for 
this option is 1.0 



Purchase price: +2 (■) 
Build quality: (□) 



2 divided by 2 criteria = 1 .0 



Scoring 



Buy 
'discount price' 
product A 



Purchase price 



Build quality 



■ 
■ 


Director Alice 
Director Bob 


1 ■ 


Accountant Carol 
Engineer Dave 





Director Alice 


□ 


Director Bob 




Accountant Carol 


■ 


Engineer Dave 




Fig. F.6c : scoring 



Buy 

'premium edition' 
product B 



□ 



□ 



■ 



Director Alice 
Director Bob 
Accountant Carol 
Engineer Dave 



Director Alice 
M Director Bob 
!EM Accountant Carol 
Engineer Dave 




The average of her 
worst/best case scores 
is 0.5 

These numbers are 
mapped to a graphical 
scale: 

-3-2-100123 



(where is exaggerated) 
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Scoring 



Purchase price 



Build quality 



Calculated scores 
(individual) 



numbers show 
worst case / average / best case 

scores 



Buy 
'discount price' 
product A 



■ 
■ 


Director Alice 
Director Bob 


1 ■ 


Accountant Carol 
Engineer Dave 



■ 1 


Director Alice 


□ 


Director Bob 


■ ■ 


Accountant Carol 


■ 


Engineer Dave 



■ 



Direc tor Alice 
0.0 1 
Director Bob 



■ 



Accou ntant Carol 

0.0 2,0 
Engineer Dave 

-i.P" r o5 



Fig. F.6d : scoring 



Buy 

'premium edition' 
product B 



Director Alice 
□ Director Bob 
■□ Accountant Carol 

Engineer Dave 

Director Alice 
M Director Bob 
CCM Accountant Carol 
Engineer Dave 



■ 



Director Alice 

ko^ 0.5 
Director Bob 

■ 



I 



- 1 .a 



Accou ntant Carol 
1.5 0.5 
Engi neer Dave 



This is how it looks after 
processing all ratings. 
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Scoring 



Purchase price 



Build quality 



Calculated scores 
(individual) 



numbers show 
worst case / average / best case 

scores 



Calculated scores 
(collective) 



Fig. F.6e : scoring 



Buy 
'discount price' 
product A 



■ 
■ 


Director Alice 
Director Bob 


1 ■ 


Accountant Carol 
Engineer Dave 



■ 1 


Director Alice 


□ 


Director Bob 


■ ■ 


Accountant Carol 


■ 


Engineer Dave 



■ 



Direc tor Alice 
0.0 1 
Director Bob 



■ 



Accou ntant Car ol 

0.0 2.0 
Engineer Dave 

-i.P" r o5 




Decision makers 
0.5 1.0 
Decision ma kers + advisors 
-0.1 1.0 



Buy 

'premium edition' 
product B 



Director Alice 
□ Director Bob 
■□ Accountant Carol 

Engineer Dave 

Director Alice 
M Director Bob 
CCM Accountant Carol 
Engineer Dave 



■ 



Director Alice 

ko^ 0.5 
Director Bob 

■ 



I 



Accou ntant C arol 
1.5 0.5 
Engi neer Dave 



Decision makers 
0.5 0.8 
Decision makers + advisors 




I 



Finally, 
the individual scores 
are merged (averaged) 
into collective scores. 



-0.3 



0.8 
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Scoring 



Purchase price 



Build quality 



Calculated scores 
(individual) 



numbers show 
worst case / average / best case 

scores 



Calculated scores 
(collective) 



Fig. F.6f : scoring 



Buy 
'discount price' 
product A 



■ 
■ 


Director Alice 
Director Bob 


1 ■ 


Accountant Carol 
Engineer Dave 



■ 1 


Director Alice 


□ 


Director Bob 


■ ■ 


Accountant Carol 


■ 


Engineer Dave 



■ 



Direc tor Alice 
0.0 1 
Director Bob 



■ 



Accou ntant Car ol 

0.0 2.0 
Engineer Dave 

-i.P" r o5 




Decision makers 
0.5 1.0 
Decision ma kers + advisors 
-0.1 1.0 



Buy 

'premium edition' 
product B 



Director Alice 
□ Director Bob 
■□ Accountant Carol 

Engineer Dave 

Director Alice 
M Director Bob 
CCM Accountant Carol 
Engineer Dave 



■ 



Director Alice 

ko^ 0.5 
Director Bob 

■ 



I 



Accountant Carol 

i i ~n 
1.5 0.5 

Engi neer Dave 



Decision makers 
0.5 0.8 
Decision makers + advisors 




I 



The collective scores 
tell us mainly that: 

- the product A option 
has a slight advantage, 
both in worst and best 
case scores 

- both options are 
acceptable 



-0.3 



0.8 
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Scoring 



Purchase price 



Build quality 



Calculated scores 
(individual) 



numbers show 
worst case / average / best case 

scores 



Calculated scores 
(collective) 



Fig. F.6g : scoring 



Buy 
'discount price' 
product A 



■ 
■ 


Director Alice 
Director Bob 


1 ■ 


Accountant Carol 
Engineer Dave 



□ 



® 



Director Alice 
Director Bob 
Accountant Carol 
Engineer Dave 



Direc tor Alice 
0.0 1 
Director Bob 



■ 



Accou ntant Carol 

0.0 2,0 
Engineer Dave 



option not acceptable 
Decision makers 
0.5 1.0 
De cision makers + advis ors 
option not acceptable 



■ 



Buy 

'premium edition' 
product B 



Director Alice 
□ Director Bob 
■□ Accountant Carol 

Engineer Dave 

Director Alice 
M Director Bob 
CCM Accountant Carol 
Engineer Dave 



■ 



Director Alice 

ko^ 0.5 
Director Bob 

■ 



I 



Accou ntant C arol 
1.5 0.5 
Engi neer Dave 



Decision makers 
0.5 0.8 
Decision makers + advisors 




I 



Note: 

If Dave would have rated 
product A's build quality 

'not acceptable', 
the scores would look 
like this. 



-0.3 



0.8 
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Scoring 



Purchase price 



Build quality 



Calculated scores 
(collective) 



Buy 
'discount price' 
product A 





■ 
■ 


Director Alice 
Director Bob 






Accountant Carol 
Engineer Dave 




■ 

□ 




Director Alice 
Director Bob 


■ 
■ 




Accountant Carol 
Engineer Dave 



Decision makers 
0.5 1.0 
Decision makers + advisors 
1.0 




Fig. F.6h : scoring 



Buy 

'premium edition' 
product B 



□ 



Director Alice 
Director Bob 



■□ Accountant Carol 

Engineer Dave 

Director Alice 
■ Director Bob 



Accountant Carol 
Engineer Dave 



Decision makers 

0.5 O.f 
Decision makers + advisors 



■ 

D.8 



-0.3 



0.8 



When presenting 
such a matrix to an 
inexperienced audience, 
consider to: 

- first show (explain) the 
matrix without scores 

- then show it with added 

collective scores 
(example to the left) 

- then show the 
individual scores 
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Would you prefer to buy product B, 
despite its slightly worse scores? 



In that case, your judgement 
may partly be based on criteria 
not included in the example 
(e.g. 'total cost of ownership' 
or 'user experience'). 



Or perhaps the 'build quality' 
criterion is more important for you 
than the 'purchase price' criterion. 

This leads us to the next section. 



Progress 



Intro done 

Why bother? done 

Basic diagram done 

Diagram upgrades : ... 

... uncertainty handling done 

... multi-party capability done 

... scoring done 

... weighted criteria up next 

... two-step ratings 

Possible mistakes 
Summary 



Often some criteria appear 
as more, some as less important 
than others. 



Their perceived importance 
depends on how well they align 
with the observer's value system. 

This implies that only people with 
similar value systems tend to 
agree on what is 'important'. 



A decision support tool, 
e.g. a multi-party decision matrix, 
should allow (not force) each party 
to attach individual 'weights' to 
each criterion. 

There are 3 different ways 
of doing this. 



1 . criteria selection 



Example: if you have 5 criteria in 
the 'finance' category and 2 in 
'environment', 'finance' weighs 
much more than 'environment'. 

2. judgement (rating) bias 

Example: 'build quality' is very 
important for Dave. Hence he 
judges this criterion very critically, 
and expresses that in his ratings. 



3. numerical weights 



A numerical weight is a factor 
applied to a criterion score, to 
make it count more/less in the 
total score. 



Numerical/visual 



weights 



Buy 
'discount price' 
product A 



Purchase price 



Build quality 



Director Alice 
Director Bob 




Accountant Carol 
ngineer Dave 



■ 1 


Director Alice 




Director Bob 




Accountant Carol 




Engineer Dave 



Fig. F.7a : numerical/visual weights 



Buy 

'premium edition' 
product B 



□ 



Director Alice 
Director Bob 



Accountant Carol 
Engineer Dave 

Director Alice 
Director Bob 



Accountant Carol 
Engineer Dave 




With only one party 
(Dave) using numerical 
weights, the diagram 
looks like this. 

Numerical weight and 
visual block height are 
proportional. 

Even without ever talking 
to Dave, you can 
directly see what he 
finds important. 
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Numerical/visual 



weights 



Buy 
'discount price' 
product A 



Purchase price 



Build quality 



Director Alice 
Director Bob 




Accountant Carol 
ngineer Dave 



■ 1 


Director Alice 




Director Bob 




Accountant Carol 




Engineer Dave 



Fig. F.7b : numerical/visual weights 



Buy 

'premium edition' 
product B 



□ 



Director Alice 
Director Bob 




Accountant Carol 
Engineer Dave 

Director Alice 
Director Bob 



Accountant Carol 
Engineer Dave 




Dave weighted 
'build quality' up, from 
default 100% to 150%. 

He also weighted 
'purchase price' down, 
from 100% to 50%. 

For simplicity, only these 
weights are allowed: 



50 100 150 200 % 
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Numerical/visual 



weights 



Buy 
'discount price' 
product A 



Purchase price 



Director Alice 
Director Bob 



Accountant Carol 
Engineer Dave 



Build quality 



1 1 


Director Alice 


□ 


Director Bob 




Accountant Carol 


■ 


Engineer Dave 



Fig. F.7c : numerical/visual weights 



Buy 

'premium edition' 
product B 



Director Alice 
□ Director Bob 
■□ Accountant Carol 

Engineer Dave 

Director Alice 
■ Director Bob 
CCM Accountant Carol 
EB Engineer Dave 



As a rule, weight can 
only be shifted between 
criteria (instead of just 
added). For instance, 
a party 'giving' extra 
100% to one criterion 
must 'take' 2x 50% from 
other criteria. 

(Otherwise score 
calculations become 
meaningless.) 
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Numerical/visual 
weights 



Buy 
'discount price' 
product A 



Purchase price 



Build quality 



Calculated scores 
(Dave, without weights) 

Calculated scores 
(Dave, with weights) 



■ 
■ 


Director Alice 
Director Bob 


n™ 


Accountant Carol 
Engineer Dave 






Director Alice 
Director Bob 




Accountant Carol 
Engineer Dave 



■ 



Engineer Dave 



1.5 0.0 
Engineer Dave 





Fig. F.7d : numerical/visual weights 



Buy 

'premium edition' 
product B 



□ 



Director Alice 
Director Bob 



■ 



Accountant Carol 
Engineer Dave 

Director Alice 
■ Director Bob 



Accountant Carol 
Engineer Dave 




Engineer Dave 



-0.5 



ive 
1.0 



Dave's new 
worst case score for the 
product A option is -2.3 



Purchase price: x 0.5 (□) = 
Build quality: -3 x 1.5 (I) = 



0.0 
-4.5 

-4.5 



-4.5 divided by 2 criteria = -2.25 

(-2.3) 
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Numerical/visual 
weights 



Buy 
'discount price' 
product A 



Purchase price 



Director Alice 
Director Bob 



Accountant Carol 
Engineer Dave 



Build quality 



Calculated scores 
(Dave, without weights) 

Calculated scores 
(Dave, with weights) 



1 1 


Director Alice 


□ 


Director Bob 




Accountant Carol 


■ 


Engineer Dave 



-1.™ 



Engineer Dave 



-2.3 



0.0 

Engineer Dave 
-1.0 




Fig. F.7e : numerical/visual weights 



Buy 

'premium edition' 
product B 



□ 



Director Alice 
Director Bob 



■ 



Accountant Carol 
Engineer Dave 

Director Alice 
■ Director Bob 



Accountant Carol 
Engineer Dave 




Engin eer Dave 

-of 1 ^.0 

Engineer Dave 



■ 




Because of the shifted 
weight, 'build quality' 
dominates Dave's 
new scores very clearly. 

With more criteria in the 
matrix, shifted weights 
have a less dramatic 
impact on scores. 
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Note: 



All parties should complete their 
ratings before considering to shift 
weights between criteria. 



For instance, if there is only one 
acceptable option left, 
there is no need for weighting 
(nor for scoring). 




Progress 



Intro 

Why bother? 

Basic diagram 

Diagram upgrades : ... 
... uncertainty handling 
... multi-party capability 

... scoring 
... weighted criteria 
... two-step ratings 

Possible mistakes 

Summary 



done 
done 
done 



done 
done 
done 
done 

up next 
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Assuming that option set and 
criteria were chosen carefully, 
the final decision quality 
depends heavily on 
how accurate the ratings are. 



Letting multiple parties do their 

ratings independently 
already reduces the impact of 
individual rating errors. 

But there is another way to 
increase both rating accuracy 
and transparency. 

The trick is to divide the rating 
evaluations into two steps. 



Example: single-step rating 



'I give the purchase price of 
product A a positive (H) rating' 



Note: 

If I base my rating on a wrong 
purchase price, nobody else can 

see my error. This is both an 
accuracy and transparency issue. 



Example: two-step rating 



1 . This is how I rate these 
purchase prices' 









+ 







- ■ 




X$ : 


200 400 600 800 1k ... 2k ... 3k 

■ i ■ i i i i 



X$ (example $) 



2. 'For product A, I expect a 
purchase price of 500 X$' 

This results in a 
positive ( H) rating. 



Single-step ratings are often 
less accurate, mostly because 
they are easily 'contaminated' 
by other criteria. 

For instance, the decision maker 
may rate the same purchase price 
as positive (H) for a well built 
product, but as negative (Q) for 
a poorly built product. 



This is intuitive but wrong, 
because 'build quality' judgements 
belong to that criterion, not to the 

'purchase price' criterion. 

Two-step ratings make it easy 
to avoid this kind of confusion, 
and to spot wrong assumptions. 



Two-step rating baselines 
(multi-party) 



Director Alice 
Director Bob 



Purchase price Mill. x$ : 



0.5 1.0 1.5 2.0 2.5 3.0 ... 5.0 

1 1 1 1 1 1 ■ — 



Accountant Carol 
Engineer Dave 



Build quality 



This criterion cannot be quantified (along one axis). 

Therefore ratings are performed directly (in the decision matrix). 



F.8a : two-step ratings (multi-party) 



Back to our familiar 
example. 

Alice and Bob are in 
charge of buying some 
expensive equipment, and 
go for two-step ratings. 

They use a new diagram 
(shown on the left) 
for that. The criteria 
are the same as in the 
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Two-step rating baselines 
(multi-party) 



Director Alice 
Director Bob 



Purchase price Mill. x$ : 



0.5 1.0 1.5 2.0 2.5 3.0 ... 5.0 

1 1 1 1 1 1 ■ — 



Accountant Carol 
Engineer Dave 



Build quality 



This criterion cannot be quantified (along one axis). 

Therefore ratings are performed directly (in the decision matrix). 



F.8b : two-step ratings (multi-party) 



The 1 . step is to establish 

baselines for how 
quantifiable facts translate 
into individual ratings. 

For instance, Carol rates 
any purchase price above 
3m X$ as 'not acceptable'. 

Note that not all criteria 
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Merged diagrams 



Two-step rating baselines 





Director Alice 
Director Bob 


Mill. X$:0 0.5 1.0 1.5 2.0 2.5 3.0 ... 5.0 




■ ■■iii ■ 


Accountant Carol 
Engineer Dave 




This criterion cannot be quantified (along one axis). 

Therefore ratings are performed directly (in the decision matrix). 




Two-step rating baselines and 
decision matrix can be merged 
into a single diagram. 




Decision matrix 



Purchase price 



Build quality 



Buy 
'discount price' 
product A 



■ 


Director Alice 


■ 


Director Bob 




Accountant Carol 




Engineer Dave 



■n 


Director Alice 


□ 


Director Bob 




Accountant Carol 


■ 


Engineer Dave 



Buy 

'premium edition' 
product B 



□ 


Director Alice 


□ 


Director Bob 




Accountant Carol 




Engineer Dave 





Director Alice 


■ 


Director Bob 




Accountant Carol 




Engineer Dave 
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Merged diagrams 



Two-step rating baselines 




Director Alice 
Director Bob 



. X$ : 



0.5 1.0 1.5 2.0 2.5 3.0 ... 5.0 



Accountant Carol 
Engineer Dave 



This criterion cannot be quantified (along one axis). 

Therefore ratings are performed directly (in the decision matrix). 



Now it becomes transparent 

on which numbers the 
individual ratings are based 

(Applies only to quantifiable criteria) 



Fig. F.9b : merged diagrams 



Decision matrix 



Buy 
'discount price' 
product A 



Buy 

'premium edition' 
product B 



Purchase price 



CD 


Director Alice 


■ 


Director Bob 




Accountant Carol 




Engineer Dave 



□ 


Director Alice 


□ 


Director Bob 




Accountant Carol 




Engineer Dave 



Build quality 



■ I 


Director Alice 


□ 


Director Bob 




Accountant Carol 


■ 


Engineer Dave 





Director Alice 


■ 


Director Bob 




Accountant Carol 


■ 


Engineer Dave 



Example: 



Alice expects (in her 2. rating 
step) a purchase price of 
about 1 m X$ for product A. 
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Merged diagrams 



Two-step rating baselines 



Director Alice 
Director Bob 



. X$ : 



0.5 1.0 1.5 2.0 2.5 3.0 ... 5.0 



Accountant Carol 
Engineer Dave 



This criterion cannot be quantified (along one axis). 

Therefore ratings are performed directly (in the decision matrix). 



And this is how it looks 
including collective scores 

(scores updated after Dave applied 
weight factors to his ratings). 



Fig. F.9c : merged diagrams 



Decision matrix 



Purchase price 



Build quality 



Calculated 
scores 
(collective) 



Buy 
'discount price' 
product A 



■ 


Director Alice 


■ 


Director Bob 




Accountant Carol 




Engineer Dave 



■ I 


Director Alice 


□ 


Director Bob 




Accountant Carol 


■ 


Engineer Dave 



Decision makers 

□ 

0.5 1.0 
Decision makers + advisors 



Buy 

'premium edition' 
product B 



□ 


Director Alice 


□ 


Director Bob 




Accountant Carol 




Engineer Dave 



■ 


Director Alice 
Director Bob 




Accountant Carol 
Engineer Dave 



II 



Decision makers 

D 

0.5 0.8 



Decision makers + advisors 



-0.3 



0.9 
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Sometimes it's easier to keep 
the two-step rating baselines 

and the decision matrix as 
separate diagrams 

(instead of merging them). 



You can still view (or present) 
them side by side when wanted. 



Two-step rating baselines 
(multi -party) 



Total costs 



of 



new Central Bus Station 
project 



Mill. X$ : 



10 15 20 25 30 



50 



Conservative party 
Liberal party 
Progressive party 



Planning committee 
Traffic department 
Consultant group 
Bus line operators 
Citizen organization 



Change in 
passenger numbers 

after 

project is completed 



% : 



-20 -10 +10 +20 +30 +40 



Conservative party 
Liberal party 
Progressive party 

Planning committee 
Traffic department 
Consultant group 
Bus line operators 
Citizen organization 



Fig. F.8c : two-step ratings (multi-party) 



/The Alice-Bob-Carol- 
Dave-prod uct-A/B 
example was very simple. 

In real life, the 'products' 
could be new bus stations, 
schools, business plans, 

tax systems, or 
foreign policy strategies. 

(Just a reminder 
regarding what this 
\^ text is about.) , 
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Progress 



Intro done 

Why bother? done 

Basic diagram done 

Diagram upgrades : ... 

... uncertainty handling done 

... multi-party capability done 

... scoring done 

... weighted criteria done 

... two-step ratings done 

Possible mistakes up next 

Summary 



The discussed diagrams 
are decision making tools 

Like many other tools, 
they deliver good results 
when handled properly. 



Otherwise not. 



So, what do you need 
to watch out for? 

Well, mistakes can occur in 
all 4 areas of the decision matrix: 

1 . the options area 

2. the criteria area 

3. the ratings area 

4. the scores area 



1. Common mistakes in the 
options area 

- not enough effort is made to find 
promising decision options. 

No decision matrix can show the 
merits of overlooked options 

- unclear or rhetorically biased 
option descriptions 
(hinder accurate ratings) 



2. Common mistakes in the 
/ criteria area 

- important criteria are not 
included ('important' for at least 
one party) 

- the criteria list is crowded with 

rather unimportant criteria 
(10-30 criteria work well in most 
situations) 

- unclear or rhetorically biased 
V criteria descriptions 

\. (hinder accurate ratings) 




3. Common mistakes in the 
ratings area 



- inconsistent ratings 

- ratings based on wrong 
assumptions 

(both discussed in the 
'two-step ratings' section) 



4. Common mistakes in the 
scores area 

- calculation errors 
(yes, it happens) 

- scores are not updated after a 
rating (or weighting) change 



Note that some of these mistakes 
are related to decision making 
in general (with or without 
diagrams). 

Certainly a major mistake would 
be to write/read tens/hundreds of 
text pages, and then to make a 

decision based on what you 
happen to remember, or on what 
was rhetorically most convincing. 



Decisions affecting the public 
should be made according to 
a suitable quality standard, 
to prevent all these mistakes, and 
to ensure good decision quality. 

(Quality standards for decision 

making are discussed in 
appendix E of the original book.) 



Progress 



Intro done 

Why bother? done 

Basic diagram done 

Diagram upgrades : ... 

... uncertainty handling done 

... multi-party capability done 

... scoring done 

... weighted criteria done 

... two-step ratings done 

Possible mistakes done 

Summary up next 



Summary 



You cannot make well-founded and good decisions 

without overview. 

In complex situations, overview requires diagrams. 

A 'multi-party decision matrix' is a diagram 
specifically designed for that purpose. 

Whether 2 or 10 decision makers, new office furniture 
or new foreign policy: this diagram reveals which 
decision options are better than others, and why. 

In addition, it speeds up the decision making process 
by replacing a lot of (report writing) paperwork. 

Because of its clear and logical structure, it can be 
explained to most audiences in about 1 minute. 
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1 minute summary 

(multi-party 
decision matrix) 



This is an A4/Letter- 
sized page. It shows 
a multi-party decision 
matrix example. Such 
diagrams are decision 
support tools. 




Calculated scores 
(collective) 



Option 1 
Description text 



Option 2 Option 3 Option 4 

Description text Description text Description text 



rm Liberal Parly 
m Progressive Pany 


■1 Progressive Parly 


■m Conservative Party 
□ Liberal Party 
rm Progressive Party 


l~m Liberal Party 
MM Progressive Pany 


rTTB Education committee 
■ Senior citizen group 


rm Education commillee 
CM Employee association 
rm Employer association 

MM Youth organization 


II II ■ Employee association 
■ Employer association 
rm Senior citizen group 


m Education committee 
m Employee association 
mm Employer association 


m Conservative Pany 
■R Progress vcPnrty 


m Conservative Party 
| Liberal Party 
CM Progressive Party 


rm Conservative Party 
□] "...IP,,,, 




■ : lOLSnnoncomrnaec 
: ■ Seror Diupn gro* 


m Education committee 
BTJ Employee association 
■ Employer association 
rm Senior citizen group 


□ Employee association 
II 1 ■ Employerassociatlon 
Mill Senior citizen group 


■ Senior citizen group 


■ Ynuthn-ganzatcn 


□ Youth organization 




m Youth organization 


: MM P-ogmm vn Party 


m Progressive Party 


rm Progressive Parly 




..■m (■OLoanon comm-aee 

: m 1 •ncicytf BMOOSlOn 
■ Ro-orr:tL7figrr>.F 
■ : : Vnuttio'gnn'TBtcn 


m Education committee 

LXBB Employer association 
□ Seniorcilizen group 
■ Youth organization 


dm Eflucalion committee 
rm Employee association 
m Employer association 
MM Senior citizen group 


mm Ed^catel'lmmlttee 
m Employee association 
■lEmployer association 
Senior citizen group 
rm Youth organization 


■ '»——. 

■ Uberal Party 
m=m Progressive Pany 




nn Conservative Party 




m Eflucalion committee 

[] Employer association 
INN Senior citizen group 
■ III Youth organization 


■ MM Senior citizen group 
II 1 ■ Youth organization 


^Efl?caUo 5 ^ommlttee 

pS Employee association 
|_| Employerassociatlon 
rm Senior citizen group 
■ Ml Youth organization 


LXB Education committee 
ITI Employer association 
m Youth organization 


LTH Conservative Pany 




■m Conservative Party 


■ Conservative Pany 


M EflXu o^rr^TiieF 

■ Youth o^an'rat on 


""□Bi E^cTfercomrnlltee 
CM Employee association 
rm Employer association 
Crm Seniorcilizen group 


rrm Eflucalion committee 
CMM Employee association 
m Employer association 

LXnBl Youlh organization 


■TTI Education committee 
m Employee association 
■m Employer association 

■1 Youth organization 










mm I bora PM) 

mi p,»,..,«p, 


□TB Liberal Party 

n P.,,,,,,.™, 


m Liberal Parly 
H Progressive Party 




CEM Senior citizen group 
m Youth organization 


!!■ Education committee 
■ SeniorciUzen group 


LXB Eflucalion committee 

Employer association 
CM Senior citizen group 
rm Youth organization 


LXB Education committee 

Senior citizen group 
□ Youth organization 


■ Conservative Pany 
□ Uberal Party 
CM Progressive Pany 


m Uberal Party 
II 1 ■ Progressive Party 


■it^n^ervattvnPony 

1 .WB PBTv 

: ■ Pirflmss*- Paly 


BXI Conservative Party 
BTJ Liheral Party 


m Eflucalion committee 
EH Senior citizen group 


!!■ Education committee 

L-L-t-M Employer association 
Seniorcilizen group 




m Education committee 
| Employee association 



II II I Youth organization 

Decision makers 



Decision makers 
+ advisors 



Decision makers 
option not acceptable 



Decision makers 
+ advisors 



LXD Youlh organization 

Decision makers 



Decision makers 
+ advisors 



option not acceptable option not acceptable 



Decision makers 
option not acceptable 



Decision makers 
+ advisors 



option not acceptable 



Fig. F.10a : 1 minute summary 
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1 minute summary 

(multi-party 
decision matrix) 



This is an A4/Letter- 
sized page. It shows 
a multi-party decision 
matrix example. Such 
diagrams are decision 
support tools. 




Option 1 
Description text 



Option 2 Option 3 Option 4 

Description text Description text Description text 



Calculated scores 
(collective) 



I I I I I Youth organization 

Decision makers 



Decision makers 
+ advisors 



Criterion 1 


■ Conservative Pany 
Liberal Party 
LXI Progressive Pany 


■■ Progressiva Parly 


H Conservative Party 
□ Liberal Party 
rm Progressive Party 


XI Conservative Pany 
rm Liberal Party 
mm Progressive Pany 


l~TT~B Education committee 

■ Senior citizen group 

COM Conservative Pany 
mi Liberal Parry 
■■ Progress-; Party 


im Education committee 
■ Employee association 
rm Employer association 

\m Youth organization 


1 1 1 1 ■ Employee association 
■ Employer association 
rm Senior citizen group 


LXI Education committee 
l~n Employee association 
l~n~n Employer association 


Criterion 2 


1X1 Conservative Party 
■ Progressive Party 


rm Conservative Party 
PPT! Liberal Part, 

□ Employee association 
1 1 1 ■ Employerassociatlon 
INN Senior citizen group 


J]" Literal Part^ Pa,,V 


m : lOLwnoncommtiec 

; ■ SernrrMuvigro.r. 
■ Youth n-ganzatcn 


CD Education committee 
■7J Employee association 
■ Employer association 
rm Senior citizen group 
□ Youth organization 


MM Employee association 
Mill Employer association 
■ Senior citizen group 
T1 Youth organization 


Criterion 3 


: m Pmgumvn Party 


□□ Progressive Party 


rm Progressive Parly 




..■m 1 option cornm-aec 

: m 1 •ncicytf BMOOSlOn 
■ SerortstlTpngroLp 
n : Vnutno'gnn'TBtcn 


□□ Education committee 

Cam Employer association 
□ Seniorcilizen group 
■ Youth organization 


D3U Education committee 
l~m Employee association 
□□ Employer association 
EH Senior citizen group 


m Employee associaUon 
^Employer association 
Senior citizen group 
rm Youth organization 


Criterion 4 


■:=r* » 

m=m Progressive Pany 






I—™* 


LXI Eflucation committee 

[] Employer association 
INN Senior citizen group 
■ III Youth organization 


■ ^S^T," 

■ MM Senior citizen group 
1 1 1 ■ Youth organization 


|_| Employerassociatlon 
l~m Senior citizen group 
■ Ml Youth organization 


Cam Education committee 
[J] Employerassociatlon 
m Youth organization 





LXLBB Youth organization 




LXBB Liberal Party 

n P.,,,,,,.™, 


□□ Liberal Parly 
H Progressive Party 




Ml— Education committee 


COM Education committee 


COM Education committee 


■ Seniorcilizen group 


Employer associatlor 
CM Senior citizen group 
m Youlh organization 


■ Youth organization 


LXI Liberal Party 
II 1 ■ Progressive Party 


■BConv-rvatNr, Party 
1 .W"a Pat, 
: B PxgmMvp Pa-ty 


■XI Conservative Party 
■■ Liberal Party 


Ml— Education committee 
m» Employerassociatlon 




LXI Education committee 
[ Employee assoeiatioi 


Seniorcilizen group 


: ■ Yojthorgan^ttcn 


MJ Youth organization 


Decision makers 


Decision makers 


Decision makers 




MM 




option not acceptable 


-0.8 0.8 


option not acceptable 


Decision makers 
+ advisors 


Decision makers 
+ advisors 


Decision makers 
+ advisors 




1 1 1 1 




option not acceptable 


-0.7 1.1 


option not acceptable 



■~m 

m 

■XI 



The considered 
decision options (choices) 
are listed here. 




Fig. F.10b : 1 minute summary 
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1 minute summary 

(multi-party 
decision matrix) 



This is an A4/Letter- 
sized page. It shows 
a multi-party decision 
matrix example. Such 
diagrams are decision 
support tools. 




The considered 
decision criteria are 
listed here. 




Fig. F.10c : 1 minute summary 



Option 1 
Description text 



Option 2 Option 3 Option 4 

Description text Description text Description text 



■ Conservative Pany 
LXB Liberal Party 
LXI Progressive Pany 


LTd" Lrbera e |TertT Pa,1y 
■ Progressive Party 


LTD Conservative Party 
□ Liberal Party 
rm Progressive Party 


■ Conservative Pany 
■m Llheral Party 
■ Progressive Pany 


rTTB Education committee 
■ Senior citizen group 
LX1 Conservative Pany 

□ZO Uberal Pa "* 

■K Progress vcPnrty 


im Education committee 
□1 Employee association 
rm Employer association 

■ Youth organization 


1 1 1 1 ■ Employee association 
■ Employer association 
rm Senior citizen group 


m Education committee 
m Employee association 
mTI Employer association 


1X1 Conservative Party 
■ Progressive Party 


LTD Conservative Party 
] Liberal Party 




■ : Fouosson oommnlee 

; ■ Sb-w MW15ro.f. 


m Education committee 
■□ Employee association 
■ Employer association 
rm Senior citizen group 


^ sr, 

□ Employee association 
1 1 1 ■ Employerassociatlon 
INN Senior citizen group 


m Senior citizen group 


■ Ynutno'annTflinn 


□ Youth organization 




mm Youth organization 


: n PrngreKi.vn Party 


m Progressive Party 


rm Progressive Parly 




-■■m 1 option comm-aee 

: m rmpioya rwumii 
■ SerorolUwigrOLp 
■K : Vnutno'gnn'Tntcn 


m Education committee 

□□■Employer association 
□ Seniorcilizen group 
■ Youth organization 


mi Education committee 
rm Employee association 
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The considered 
decision options (choices) 
are listed here. 




431 



1 minute summary 

(multi-party 
decision matrix) 



This is an A4/Letter- 
sized page. It shows 
a multi-party decision 
matrix example. Such 
diagrams are decision 
support tools. 




The considered 
decision criteria are 
listed here. 



Option 1 
Description text 



Calculated scores 
(collective) 



Option 2 Option 3 Option 4 

Description text Description text Description text 
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The considered 
decision options (choices) 
are listed here. 





The decision makers 
and their advisors 
rate (evaluate) the 

option/criterion 
combinations here. 




Fig. F.10d : 1 minute summary 
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1 minute summary 

(multi-party 
decision matrix) 



This is an A4/Letter- 
sized page. It shows 
a multi-party decision 
matrix example. Such 
diagrams are decision 
support tools. 




The considered 
decision criteria are 
listed here. 




Option 1 
Description text 



Option 2 Option 3 Option 4 

Description text Description text Description text 
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Decision makers 
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The considered 
decision options (choices) 
are listed here. 




The decision makers 
and their advisors 
rate (evaluate) the 
option/criterion 

combinations here. 



Calculated scores (points) 
for acceptable options 
are shown here. 




Fig. F.10e : 1 minute summary 
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1 minute summary 

(multi-party 
decision matrix) 
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Fig. F.1 Of : 1 minute summary 
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If necessary, the 
diagram can extend 
over more pages. 
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1 minute summary 

(multi-party 
decision matrix) 




Fig. F.10g : 1 minute summary 
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This is how option 3 
is rated on criterion 7. 
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1 minute summary 

(multi-party 
decision matrix) 
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Fig. F.10h : 1 minute summary 
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Decision maker 3 
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Advisor 3 
Advisor 4 
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All ratings are chosen 
from the scale above. 
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1 minute summary 

(multi-party 
decision matrix) 
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Block height 
indicates 
criterion priority 
(weight). 
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Fig. F. 1 0i : 1 minute summary 
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1 minute summary 

(multi-party 
decision matrix) 
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Multiple ratings reflect 
worst/best case 
considerations 
(uncertainty). 



worst case best case 



Fig. F. 1 0j : 1 minute summary 
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1 minute summary 

(multi-party 
decision matrix) 
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Similar and diverging views, 
as well as possible problems, 
can easily be spotted. 
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possible problem, 
overlooked by others? 



Fig. F.10k : 1 minute summary 
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Back to the primary reason for 
using such diagrams: 

They are tools that help you to 

avoid the problems 
a bad decision would cause. 

(They can even help you to 
make really good decisions.) 



Better decisions, 
less problems, 
better quality of life. 



This is the last page 
of this excerpt. 



If you've read it: Thank you. 



